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Abstract 



We consider the problem of optimal multiple switching in finite horizon, when the state of 
the system, including the switching costs, is a general adapted stochastic process. The problem 
is formulated as an extended impulse control problem and completely solved using probabilistic 
tools such as the Snell envelop of processes and reflected backward stochastic differential equations. 
Finally, when the state of the system is a Markov diffusion process, we show that the vector of 
value functions of the optimal problem is a viscosity solution to a system of variational inequalities 
with inter-connected obstacles. 
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1 Introduction 
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Optimal control of multiple switching models arise naturally in many applied disciplines. The pio- 



neering work by Brennan and Schwartz (1985), proposing a two- modes switching model for the life 
cycle of an investment in the natural resource industry, is probably first to apply this special case of 
stochastic impulse control to questions related to the structural profitability of an investment project 
or an industry whose production depends on the fluctuating market price of a number of underlying 
commodities or assets. Within this discipline, Carmona and Ludkosvki (2005) and Deng and Xia 
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(2005) suggest a multiple switching model to price energy tolling agreements, where the commodity 
prices are modeled as continuous time processes, and the holder of the agreement exercises her man- 
agerial options by controlling the production modes of the assets. Target tracking in aerospace and 
electronic systems (cf. Doucet and Ristic (2002)) is another class of problems, where these models 
are very useful. These are often formulated as a hybrid state estimation problem characterized by a 
continuous time target state and a discrete time regime (mode) variables. All these applications seem 
agree that reformulating these problems in a multiple switching dynamic setting is a promising (if not 
the only) approach to fully capture the interplay between profitability, flexibility and uncertainty. 

The optimal two-modes switching problem is probably the most extensively studied in the literature 
starting with above mentioned work by Brennan and Schwartz (1985), and Dixit (1989) who considered 
a similar model, but without resource extraction - see Dixit and Pindyck (1994) and Trigeorgis (1996) 
for an overview, extensions of these models and extensive reference lists. Brekke and 0ksendal (1991) 
and (1994), Shirakawa (1997), Knudsen, Meister and Zervos (1998), Duckworth and Zervos (2000) and 
(2001), Zervos (2003) and Pham & Vath (2007) use the framework of generalized impulse control to 
solve several versions and extensions of this model, in the case where the decision to start and stop the 
production process is done over an infinite time horizon and the market price process of the underlying 
commodity X is a diffusion process, while Trigeorgis (1993) models the market price process of the 
commodity as a binomial tree. Hamadene and Jeanblanc (2007) consider a finite horizon optimal 
two-modes switching problem when the price processes are only adapted to the filtration generated 
by a Brownian motion while Hamadene and Hdhiri (2006) extend the set up of the latter paper to the 
case where the price processes of the underlying commodities are adapted to a filtration generated by 
a Brownian motion and an independent Poisson process. Porchet et al. (2006) also study the same 
problem, where they assume the payoff function to be given by an exponential utility function and 
allow the manager to trade on the commodities market. Finally, let us mention the work by Djehiche 
and Hamadene (2007) where it is shown that including the possibility of default or bankruptcy in the 
two-modes switching model over a finite time horizon, makes the search for an optimal strategy highly 
nonlinear and is not at all a trivial extension of previous results. For example, when the market price 
of the underlying commodities is a diffusion process, these optimal strategies are related to a system 
of variational inequalities with inter-connected obstacles, for which very few existence and regularity 
results are known in the literature. 

An example of the class of multiple switching models discussed in Carmona and Ludkovski (2005) 
is related to the management strategies to run a power plant that converts natural gas into electricity 
(through a series of gas turbines) and sells it in the market. The payoff rate from running the plant 
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is roughly given by the difference between the market price of electricity and the market price of gas 
needed to produce it. 

Suppose that besides running the plant at full capacity or keeping it completely off (the two-modes 
switching model), there also exists a total of q — 2 (q > 3) intermediate operating modes, corresponding 
to different subsets of turbines running. 

Let £ij denote the switching costs from state i to state j, to cover the required extra fuel and 
various overhead costs. Furthermore, let X = (X t ) t > denote a vector of stochastic processes that 
stands for the market price of the underlying commodities and other financial assets that influence 
the production of power. The payoff rate in mode i, at time t, is then a function ipi(t, X t ) of X%. 

A management strategy for the power plant is a combination of two sequences: 

(i) a nondecreasing sequence of stopping times (r n ) ra >o, where, at time r n , the manager decides to 
switch the production from its current mode to another one; 

(n) a sequence of indicators (£ n )n>i taking values in {l,...,q} of the state the production is 
switched to. At r„ the station is switched from its current mode £ n _i to £„. 

When the power plant is run under a strategy (8, u) = ((r n ) n >i, (£ n )n>i), over a finite horizon 
[0, T], the total expected profit up to T for such a strategy is 

rT 

J(5,u) =E[ i> Us (s,X s )ds - $Z £ «r„-i.«T>,( r n) 1 [T„<r|] 
J0 n>l 

where u s = £ n if s € [r n _i,r„[ (r = 0). 

The optimal switching problem we will investigate is to find a management strategy (8*,u*) = 

(«)n>l, (Sn)n>l) such that 

J(6*,u*) = sup J(8, u). 

(8,u) 

Using purely probabilistic tools such as the Snell envelop of processes and backward SDEs, inspired 
by the work by Hamadene and Jeanblanc (2007), Carmona and Ludkovski (2005) suggest a powerful 
robust numerical scheme based on Monte Carlo regressions to solve this optimal switching problem 
when A is a diffusion process. They also list a number of technical challenges, such as the continuity of 
the associated value function etc., that prevent a rigorous proof of the existence and characterization 
of an optimal solution of this problem. 

The objective of this work is to fill in this gap by providing a complete treatment of the optimal 
multiple switching problem, using the same framework. We are able to prove the existence and provide 
a characterization of an optimal strategy of this problem, when A and the switching costs £ij are only 
adapted to the filtration (Tt)t>o generated by a Brownian motion. 
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We first provide a Verification Theorem that shapes the problem, via the Snell envelope of pro- 
cesses. We show that if the Verification Theorem is satisfied by a vector of continuous processes 
(Y 1 , . . . , Y q ) such that, for each i € {1, . . . , q}, 

Y'l = ess sup T>t E[ [ ipi(s,X s )ds + max(-%(r) + Yf)h T<T] | F t \. 

then each Y£ is the value function of the optimal problem when the system is in mode i at time t: 

Y l t = ess sup (5:U)eT)t E[ / 4> Us {s,X s )ds - ^ t u - (Tj)l [Tj<T] \F t ]. 

where V t is the set of strategies such that t\ > t a.s. 

An optimal strategy (S*,u*) is then given by the optimal stopping times corresponding to the Snell 
envelop. Moreover, it holds that Yq = sup s J (5), provided that the system is in mode i = 1 at time 
t = 0. 

The unique solution for the Verification Theorem is obtained as the limit of sequences of processes 
(Y l ' n ) n >o where, V/' n is the value function (or the optimal yields) from t to T, when the system is in 
mode i at time t and only at most n switchings after t are allowed. This sequence of value functions 
is defined recursively as follows. 

Yt fi = ElJ t Ms,X s )ds\T t ] 

and, for n > 1, 

Y*' n = ess sup T>t E[ [ T fPi( 8 , X s )ds + max(-^(r) + Y^' 1 )!^ \F t \. 

Finally, if the process X is an Ito diffusion, with infinitesimal generator A, and each £ij(i) is a de- 
terministic function of t, we prove existence of q deterministic continuous functions x), . . . , v q (t, x) 
such that for any i G {1, . . . , q}, Y^ = v i (t, Xt). Moreover, the vector (v 1 , . . . , v q ) is a viscosity solution 
of the following system of q variational inequalities with inter-connected obstacles. 

mm{(f)i(t, x)-max(-£ij(t)+(f)j(t, x)), -d t (pi(t, x)-A(f>i(t, x)-ipi(t, x)} = 0, 4>i{T,x) = 0, i € {1, . . . ,q}. 

3^1 

The organization of the paper is as follows. In Section 2, we give a formulation of the problem and 
provide some preliminary results. Sections 3 & 4 are devoted to establish the Verification Theorem 
and provide an optimal strategy to our problem. In Section 5, we show that, when the driving process 
X is an Ito diffusion, the vector of value functions of our optimal problem is a viscosity solution of 
a system of variational inequalities with inter-connected obstacles. Finally, in Section 6, we provide 
yet another numerical scheme that may be useful in simulating the value-processes satisfying the 
Verification Theorem. 
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2 Formulation of the problem and preliminary results 

The finite horizon multiple switching problem can be formulated as follows. Let J := {1, q} be the 
set of all possible activity modes of the production of the commodity. Being in mode i, a management 
strategy of the project consists, on the one hand, of the choice of a sequence of nondecreasing stopping 
times (r n ) n >i (i.e. r n < r n +i and To = 0) where the manager decides to switch the activity from its 
current mode, i, to another one from the set J~ l := {1, . . . , i — 1, % + 1, . . . , q}. On the other hand, it 
consists of the choice of the mode £ n to which the production is switched at r n from the current mode 
i ; is a random variable which takes its values in J and is T Tn -measurable. 

Assuming that the production activity is in mode 1 at the initial time t = 0, let {ut)t<T denote the 
indicator of the production activity's mode at time t G [0,T]: 

(*)+E& 1 (T»,T„ +1 ](*)- (1) 

n>l 

Note that 5 := (r n ) n >i and the sequence £ := (£ n )n>i determine uniquely u and conversely, 5 and u 
determine uniquely (£ n )n>i- 

A strategy for our multiple switching problem will be simply denoted by (S, u). 

Finally, let (X t )o<t<T denote the market price process of e.g. k underlying commodities or other 
financial assets that influence the profitability of the production activity. 

The state of the whole economic system related to the project at time t is represented by the vector 

(t,X t ,u t ) £[0,T]x M k x J. (2) 

Let ipi(t, x) be the payoff rate per unit time when the system is in state (t, x, i), and for i, j £ J (i / j), 
tij '■= (£ij(t))t<T denotes the switching cost of the production at time t from its current mode i to 
another mode j. 

The expected total profit of running the system with the strategy (5, u) is given by: 
J(5,u) = E[ ^ Us {s,X s )ds-^£ UTn _ i:UTn {T n )l [Tn<T] }. 

J0 n>l 

Solving the optimal multi-regime starting and stopping problem turns into finding a strategy (5* , u* ) 
such that J(5*,u*) > J(S,u) for any other strategies (8,u). 

2.1 Assumptions 

Throughout this paper (fi, JF, P) will be a fixed probability space on which is defined a standard d- 
dimensional Brownian motion B = (B t )o<t<T whose natural filtration is (J^ := a{B s ,s < i})o<t<T- 
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Let F = {Ft)o<t<T be the completed filtration of {?f)o<t<T with the P-null sets of T '. Hence F 
satisfies the usual conditions, i.e., it is right continuous and complete. 
Furthermore, let: 

- V be the cr-algebra on [0, T] x U of F-progressively measurable sets ; 

- Ai p ' 1 be the set of "P-measurable and iR'-valued processes w = {wt)t<T such that E[f \w s \ p ds] < 
oo and S p be the set of "P-measurable, continuous, iR-valued processes w = (w t )t<T such that 
£'[sup 0<t<T \ w t \ p ] < oo (p > 1 is fixed) ; 

- For any stopping time r G [0, T], T T denotes the set of all stopping times 6 such that r < 8 <T, 
P-a.s.. 

We now make the following assumptions on the data: 

(i) The market price X := (X t )o<t<T is iR fc -valued and each component belongs to S p . 

(ii) The functions ipi(t, x), (t, x) G [0, T] x M k and i <G J, are continuous and satisfy a linear growth 
condition, i.e. there exists a constant C such that \ipi(t,x)\ < C(l + \x\) for < t < T and 

x G 

(iii) The processes iij belong to S p and there exists a real constant 7 > such P-a.s. for any 

< t < T, mm{£ l:j (t),i,j £j,i^j}> 7. 

(iv) (r ra ) ra >i are F-stopping times and (£ ra )n>i are random variables with values in J and such that for 
any n > 1, £ n is ^v n -measurable. Additionally, we assume that for any n > 1, P[£„ = Cn+i] = 0. 
The strategies (5, u) = ((r ra ) n >i, (^ n )n>i) are called admissible if they satisfy: 

lim T n = T P — a.s. 

n— >oo 

The set of admissible strategies is denoted by V a . 

Remark 1 The above assumptions on X and ipi, i=l,. . . ,q, can be modified or weakened in any way 
which preserves the fact that the process (fpi(t, X t ); < t < T, i G J) belongs to MP' 1 . 

We can now formulate the multi-regime starting and stopping problem as follows: 
Problem 1 Find a strategy (S*,u*) = ((r*) n >i, (C)n>i) £ £>a such that 

J(5*,u*)= sup J(5,u). (3) 

(5,u)ev a 
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An admissible strategy (S, u) is called finite if, during the time interval [0, T], it allows the manager 
to make only a finite number of decisions, i.e. P[u),T n {u)) < T, for all n > 0] = 0. Hereafter the 
set of finite strategies will be denoted by V. The next proposition tells us that the supremum of the 
expected total profit can only be reached over finite strategies . 

Proposition 1 The suprema over admissible strategies and finite strategies coincide: 



Proof. If (8, u) is an admissible strategy which does not belong to V, then J(5) = -co. Indeed, let 
A = {lo, T n (uj) < T, for all n > 0} and A c be its complement. Since (5, u) £ T> a \ V, then P(A) > 0. 
Since the process X belongs to S p and ipi is of linear growth, then the processes (ipi(t, X t )) t <T belongs 
to M p ' 1 . Therefore, 



-^[{EnM^^AjTn)}^ + {En>l Vl^^) 1 ^^]]} 1 ^] = -OO, 

since for any t < T and i,j E J, tij(t) > 7O. This implies that J(S,u) = —00 and then 
s^P(s,u)&v a J (8, «) = sup (MeI > J (5, u). □ 

We finish this section by introducing the key ingredient of the proof of the main result, namely 
the notion of Snell envelope and its properties. We refer to Cvitanic and Karatzas (1996) , Appendix 
D in Karatzas and Shreve (1998), Hamadene (2002) or El Karoui (1980) for further details. 

2.2 The Snell Envelope 

In the following proposition we summarize the main results on the Snell envelope of processes used in 
this paper. 

Proposition 2 Let U = (Ut)o<t<T be an F '-adapted M-valued cadlag process that belongs to the class 
[D], i.e. the set of random variables {U T , r G Tq} is uniformly integrable. Then, there exists an 
F-adapted M-valued cadlag process Z := (Z t )o<t<T such that: 

(i) Z is the smallest super-martingale which dominates U, i.e, if (Z t )o<t<T is another cadlag su- 
permartingale of class [D] such that for all < t < T , Z t > Ut then Z t > Z t for any < t <T. 

(ii) For any F -stopping time 6 we have: 



sup J (5, u) 

(s,u)ev a 



sup J(6,u). 

(5,u)eT> 



(4) 




Zq = ess sup re j- g E\U T \J : Q\ {and then Zt = Ut). 



(5) 



The process Z is called the Snell envelope ofU. 
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Moreover, the following properties hold: 

(Hi) The Dood-Meyer decomposition of Z implies the existence of a martingale (Mt)o<t<T and two 
nondecreasing processes (A t )o<t<T and (B t )o<t<T which are respectively continuous and purely 
discontinuous predictable such that for all < t < T , 

Z t = M t -A t -B t (with A = B = 0). 

Moreover, for anyO<t<T, {A t B > 0} C {A t U < 0} n {Z t _ = U t -}. 

(iv) If U has only positive jumps then Z is a continuous process. Furthermore, if 6 is an F -stopping 
time and Tq = inf{s > 6,Z S = U s } A T then Tq is optimal after 6, i.e. 

Z e = E[Z T . \F e ] = E[U T * \F e ] = ess sup T > e E[U T \T e } ■ (6) 

(v) If (U n ) n >o and U are cddldg and of class [D] and such that the sequence (U n ) n >o converges 
increasingly and pointwisely to U then (Z u ™) n >o converges increasingly and pointwisely to Z u ; 
Z u ™ and Z u are the Snell envelopes of respectively U n and U . Finally, if U belongs to S p then 
Z u belongs to S p . 

For the sake of completeness, we give a proof of the stability result (v). 
Proof of (v). Since, for any n > 0, U n converges increasingly and pointwisely to U, it follows that 
for all t e [0,T], Zf n < Zf P-a.s. Therefore, P - a.s., for any t G [0,T], lim n _ >00 Zf" < Zf . Note 
that the process (limn^oo Z t f/n )o<t<r is a cadlag supermartingale of class [D], since it is a limit of 
a nondecreasing sequence of supermartingales (see e.g. Dellacherie and Meyer (1980), pp.86). But 
jjn < z u n implies that p _ a s ; for all t G [o, T],U t < lim,,^^ zy Thus, Zf < lining Z? " since 
the Snell envelope of U is the lowest supermartingale that dominates U. It follows that P — a.s., for 
any t < 1, lim^oo Z^ 1 " = Zf whence the desired result. 

Assume now that U belongs to S p . Since, for any < t < T, — -E[sup 0<s<r \U S \ \Tt\ < Ut < 
E[sup 0<s<T \U a \\Ft], using the Doob-Meyer inequality, it follows that Z u also belongs to S p . □ 

3 A verification Theorem 

In terms of a verification theorem, we show that Problem 1 is reduced to the existence of q continuous 
processes Y 1 , . . . , Y q solutions of a system of equations expressed via the Snell envelopes. The process 
Y^, for i G J , will stand for the optimal expected profit if, at time t, the production activity is in the 
state i. 
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Set 

D T (C = C) :=mi{s>T,( s = C s }AT, 

where, r is an F-stopping time and ((t)o<t<T, (Ct)o<t<T are two continuous F-adapted and M— valued 
processes. 

Theorem 1 (Verification Theorem) 

Assume there exist q S p -processes (Y l := (Y t l )o< t <T, i = 1, • • • , q) that satisfy 

Y t l = ess sup T > t E[f[ ipi(s, X s )ds + max j&J -i (— -4/(t) + y/)l[ T<T ] \Tt] {and then Y% = 0). (7) 
Then Y 1 , . . . , Y q are unique. Furthermore : 
(0 

Yj= sup J(0,v). (8) 
(0,v)ev 

(ii) Define the sequence of 'F -stopping times (r n ) n >i by 

ti = DoiY 1 = max jei7 -i(-^ + y')) (9) 



and, for n > 2, 



where, 



T n = D Tn _ 1 (Y^- 1=maKkeJ _ Tn _ l{ -i Tn _ ik + Y k )), (10) 



«n - Eje 1 7i 1 { m ax fcei:7 _ 1 (-4 fc (r 1 )+y T fc 1 )=^i J (r 1 )+y T J 1 } ; 

• For anyn>\ and t > r n , Y? Tn = Y, jeJ l[ UTn=j ]Y t J ; 

• Forn> 2, u Tn = I on the set {max k( _ J -u Tn _ 1 (-4 Tn _ 1 fc(r n ) + Y T k J = -4 Tn _ 1 /(r n ) + Y* n }, 
where, i UTn ^k{T n ) = E je j % n -i=j\^k{ T n) and J~ u -n-i = J2 je j \ [Tn _ 1=j] J~K 

Then, the strategy (S,u) is optimal i.e. J(5,u) > J(6,v) for any (6,v) £ V. 

Proof. The proof consists essentially in showing that each process Y % , as defined by (7), is nothing 
but the expected total profit or the value function of the optimal problem, given that the system is in 
mode i at time t. More precisely, 

rT 



] 'I - sup (<5iU)6A E[ f V« s (s, X s )ds - 4 r ._ lWr . {Tj)\ [Tj<T] \F t ], (11) 

j>i 



where V t is the set of finite strategies such that t\ > t, P-a.s. if at time t the system is in the mode i. 
This characterization implies in particular that the processes Y 1 , . . . , Y q are unique. Moreover, thanks 



to a repeated use of the characterization of the Snell envelope (Proposition 2, (iv)), the strategy (S,u) 
defined recursively by (9) and (10), is shown to be optimal. 

Indeed, since at time t = the system is in mode 1, it holds true that, for any < t < T, 

Yt + f Ms,X s )ds = ess sup r>t £[ f \p 1 (s,X s )ds + max (-^-(r) + Y^)l [T<T] \T t ]. (12) 
jo ~ Jo jej- 1 

But, Yq is J^o-measuvable. Therefore it is P — a.s. constant and then Yq 1 = .EfY^ 1 ]. 

On the other hand, according to Proposition 2, (iv), t\ as defined by (9) is optimal, 1^=0 and 



Therefore, 



U T1 - ^i 1 {max feei7 _ 1 (-£ lfc (n)+y T '= 1 )=-^(n)+^ 1 }- 



(13) 



Fo 1 = £7[jT X s )ds + maxt-^n) + i^)l [n <r|] 
= E[£ Ms,X s )ds + (-4„ T1 (n) +Y T U ^)1 [T1<T] ]. 
Next, we claim that P-a.s. for every t € [ti,T], 

y" T1 = ess sup T>t £[ f T ^ (s, X s )ds + max (-£ Urij (r) + Yj)l [T<T] \T t }. (14) 
Jt jeJ- UT i 

To see this, recall that for any i G J and < t < T 

Yf = ess sup T>t E[ f 4>i(s, X s )ds + max (-^(r) + Y^)h T<T] \T t \. 
Jt iaJ- 1 

This also means that the process (V/ + J * ipi(s, X s )ds^ ^ is a supermartingale which dominates 

( f ^i(s,X s )ds + max (-*«(*) + Y t j )l [t<T] ) 

\Jo j&J-> J <t<T 

This implies that the process (TL[ u ^ =i] (Y t l + ipi(s, X s )ds)j^ is a supermartingale which domi- 



nates 



U[u t , = AI Ms,X s )ds + max (-^(t) + Y t j )l [t<T] )) 

V 1 Jri jej 1 / te[n,T] 

Since J7" is finite, the process (j2iej ^-[u T1=i] (Xi + /ri ^M 5 ; -^s)^ s )) t j r is & l so a supermartingale 
which dominates (j2 ieJ l Ki=i] (j£ ^(a, X s )ds + 

Thus, the process (Y^ T1 + / Vv (s,X s )ds) is a supermartingale which is greater than 

V 1 1 /te[Ti,T] 

( f V> Uti (s, X s )ds + max (-4 T1 j(i) + Y t j )l [t<T] ) . (15) 

v-i ^j-— J te[TuT] 

To complete the proof it remains to show that it is the smallest one which has this property and use 
the characterization of the Snell envelope (Proposition 2, (i) — (ii)). 
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Indeed, let (Zt)te[ T1 ,T\ be a supermartingale of class [D] such that, for any t G [ti,T], 

Z t > [ ipu T1 {s,X s )ds + max (-£ u j(t) +Y t J )h t<T] . 



It follows that for every t G [ti , T] , 

Za [uT1 =i] > l[ Uri =i] f / ^(s,X s )ds+ ,max.(-^-(i) +y/)l [t<T] ) . 
But, the process {Z t ^-[ UTi= i])te[Ti,T} is a supermartingale and for every t G [ti,T], 

l[« Tl =i] y ^ = ess su Pr>t^[lK 1= i]( / Ms,X s )ds + max (-^(r) + Y/)l [T<T] )|F t ]. 
It follows that, for every £ G [n, T], 

K[u T1 =i]Zt > l Ki=i] (F/+ / ^(s,X s )ds). 
Summing over i, we get, for every f G [ti,T], 

Z t >Yt T1 + f ^ UT1 (s,X s )ds. 
Jti 

Hence, the process (y^ 1 + ip Uri (s, X s )ds^ ^ is the Snell envelope of 
( / 4>u T .{s,X s )ds+ max (-£ UT1 j(t) + Y t J )l [t<T] ) 

V^i / t6[n ,T] 

whence Eq. (14). 

Now, from (14) and the definition of r 2 in Eq. (10), we have 

= E[tf ^ (s,X s )ds + max jeJ - BT1 (-^ifo) + *7 2 ) W] \F n ] 
= mil ^ («, + (-4 T1 « T2 (r 2 ) + Y^)1 [T2<T] \F T1 \. 

Setting this characterization of Y T " T1 in (13) and noting that l[ n <T] is F-n -measurable, it follows that 

^ = E[£ Ms, X s )ds - £ 1UT1 (ri)l [n<21 ] 

+F[f^ ^u T1 («) X s )ds.TL[ T1< T] — t-u T1 u T2 ( t 2)^[t 2 <T] 

+y:pi [T2<t] ] 

[T2<T]J> 

v 

since [r 2 < T] C [n < T]. 

Repeating this procedure n times, we obtain 



Y L = E[ / M (s, X s )ds - tu Tj _ lUTj (Tj)!^] + Y%* l [Tn<T] ] 

J0 7 = 1 



(16) 
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But, the strategy 5 = (r n ) n >i is finite, otherwise Yq 1 would be equal to — oo contradicting the as- 
sumption that the processes Y J belong to S p . Therefore, taking the limit as n — > oo we obtain 
Yj = J(6,u). 

To complete the proof it remains to show that J(5, u) > J(0, v) for any other finite admissible strategy 

(6,v) := ((6» n ) n >i, (Cn)n>l)- 

The definition of the Snell envelope yields 

Yq 1 > E[Jo 1 M*, *s)ds + max je<7 -i(-^(ei) + Y^)l [( , 1<r] ] 
> E[J^ Ms,X s )ds + (-hv^) +Y^)l [ei<T] \. 

But, once more using a similar characterization as (14), we get 
^ >EU 



< 91 > E[f d 9 * ^ (s,X s )ds + max. eJ -„ (i (-^(fc) + ^ 2 ) W] I^J 



> E\J£ ^ (s, X s )ds + (-£ VeiV62 (0 2 ) + V 2 )1 [92 <T] I^J- 
Therefore, 

Yo 1 > E[J^ X s )ds] - £ lvei ((9i)l Pl< r|] 

+ £; [ 1 [9kt] if ipv 01 ( s , x s)ds - iv ei v e2 (0 2 )l[e 2< T} + Yq 2 2 l[e 2 <T]] 

= e[jH 2 m (s, x s )ds - e 1V9i (0i)i [ei < T ] - V»« 2 (02)i [e2 <T] + Y e v 2 e n [e2<T] ]. 

Repeat this argument n times to obtain 

r6„ n 
Y, l >E[ M(s,X s )ds-J2^ en iVen (9 n )l [en<T] +Y^l [en<T] ]. 

3=1 

Finally, taking the limit as n — > oo yields 

Y, 1 > E[ f M (S, X s )ds - V ,v 6n (On)l [dn <T]] = HO, V) 

■Jo j > 1 

since the strategy (6,v) is finite. Hence, the strategy (5, u) is optimal. The proof is now complete. □ 

4 Existence of the processes (Y 1 , . . . , Y q ). 

We will now establish existence of the processes (Y 1 , . . . , Y q ). They will be obtained as a limit of a 
sequence of processes (Y 1 '™, . . . , Y 9 ' n ) ra >o defined recursively as follows. 
For i € J, set, for every < t < T, 

Y^ = E[J% l (s,X s )ds\T t ], (17) 

and, for n > 1, 



Y/' n = ess 



Bvp T>t E[[ T il> i (s,X a )ds+ max (-£ ik ( T ) +Y T k > n - 1 )l [T<T] \F t }. (18) 
Jt keJ-* 
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Set V\' n = {(8,u) = ((r„) n >i, (£ n )n>i) such that u = i,r 1 >t and r n+1 = T}. 

Using the same arguments as the ones of the Verification Theorem, Theorem 1, the following charac- 
terization of the processes Y l ' n holds true. 

rT n 

Y 't n = ess sup {Su)eV i,nE[ / iji Us (s,X s )ds - ^ 4 r ._ lUr . (Tj)l [Tj<T] \F t ]- (19) 

In the next proposition we collect some useful properties of Y 1,n , . . . ,Y q,n . In particular, we show 
that, as n — > oo, the limit processes Y % := bim^oo Y l,n exist and are only cadlag but have the same 
Characterization (7) as the Y l 's. Thus, the existence proof of the Y l, s will consist in showing that Y l, s 
are continuous and hence satisfy the Verification Theorem. This will be done in Theorem 2, below. 

Proposition 3 (i) For each n > 0, the processes Y 1,n , . . . , Y q,n are continuous and belong to S p . 

(ii) For any i £ J , the sequence (l" i,n ) n >o converges increasingly and pointwisely P-a.s. for any 
< t < T and in MP' 1 to cadlag processes Y l . Moreover, these limit processes satisfy 



E[ sup [y/H < oo, i€j. (20) 

0<t<T 

(6) For anyO<t<T, 

Yl = ess sup T>t E[ [ iPi(s,X s )ds + max.(-^ fe (r) + Y?)1 [t<t] \F t }. (21) 



Proof, (i) Let us show by induction that, for any n > 0, Yp n = and Y t,n € S p , for every i <G J. 
For n = the property holds true since the process (tpi(s, X s ))o< s <t belongs to S p . Suppose now 
that the property is satisfied for some n. By Proposition 2, for every i £ J and up to a term, Y i,n+1 

is the Snell envelope of the process ( / ipi(s,X s )ds + max (—£ik(t) + Y t k,n )l\ t<T ] ) and verifies 

\Jo keJ-> V <t<T 

Y^' n+1 = 0. Since max fcg j- l (— Uk{t) + Y t h ' n )\ < 0, this process is continuous on [0,T) and have a 

\t=T 

positive jump at T, Y l,n+1 is continuous and belongs to S p . This shows that, for every i <G J, Y^ n = 
and Y l ' n € S p for any n > 0. 

(ii) We show by induction on n > 0, that for each i £ J , 

rT 

Y l ' n < Y l ' n+1 < E[ / max |^(s, X s )\ds\F t ]. 

Jt »=l,-,9 

For n = the property is obviously true, since it is enough to take r = T in the definition of Y' hl to 
obtain that Y 1 ' 1 > Y 1 ' . On the other hand taking into account that £{j > 7 > we have 

Yf' 1 = ess su Pr>t £[ f T Ms, X s )ds + max (-i lk {r) + Y T fc '°)lL [r<T] \F t ] 
Jt keJ ~^ 

< ess sup T>t E[ [ i)i(s,X s )ds + E[[ max \iPi(s, X s )\ds\F T ]\F t ] (22) 

Jt Jt »=l,->9 

< ^[/t TmaX i=l,-,9 ^{s.Xs^ds^t}. 
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Suppose now that, for some n, we have 

f T 

yi,n < Y z,n+1 < ^ / max |^.( S) X s )|ds|JP t ], i G J. 
Jt »=l,...,g 

Replace y i - ri+1 by Y i ' n in the definition of y*>™+ 2 , to obtain that y i '™+ 2 > Y' l > n+1 . 
Finally, as is the case for Y 1 ' 1 in (22), we also have 

Yi' n+2 <E[[ T max \^i(s,X s )\ds\F t }, <t <T. 

Therefore, for every i E ^T, the sequence (y J,n ) n >o is increasing in n and satisfies 

Yi' n <E[f max \i>i(s,X s )\ds\F t ], 0<,t<T. (23) 
Jt i=i,-,? 

Therefore, it converges to some limit Y^ := limn^oo y/' that satisfies 

y i,o < < ^[ /* T max |^.( S) X s )|ds|^ t ], < t < T. 

Jt i=l,-,q 

Now, using the smoothness properties of ipi, Doob's Maximal Inequality yields that, for each i G J, 



E[ sup |y/| p ] < oo. 

0<t<T 

By the Lebesgue Dominated Convergence Theorem, the sequence (y i,ra ) ra >o also converges to Y % in 
M p ' x . 

Let us now show that Y % is cadlag . We note that, for each n > 1 and i G J, the process 
(V/' n + Jq ^i(s, X s )ds^ 0<t<T ^ s a continuous supermartingale, since, by Eq. (18), it is the Snell en- 
velope of the continuous process ( / ^i(s,X s )ds + max (— 4fc( r ) + l^^'"" - 1 )l^ <T i J . Hence, its 

\J0 fceJ- 1 V <t<T 

limit process ^y/ + fQipi(s,X s )ds^j 0<t<T 1S cadlag , as a limit of increasing sequence of continuous 
supermartingales. Therefore, Y l is cadlag . 

Finally, the cadlag processes Y 1 , . . . , Y q satisfy Eq. (21), since they are limits of the increasing sequence 
of processes Y l ' n , i £ J, that satisfy (18). We use Proposition 2, (v) to conclude. □ 

We will now prove that the processes Y 1 , . . . ,Y q are continuous and satisfy the Verification The- 
orem, Theorem 1. 

Theorem 2 The limit processes Y 1 , . . . ,Y q satisfy the Verification Theorem. 

Proof. Recall from Proposition 3 that the processes Y 1 ,. . . ,Y q are cadlag , uniformly L p -integrable 
and satisfy (21). It remains to prove that they are continuous. 

Indeed, note that, for i G J, the process (y£ + Jq tpi(s, X s )ds^j is the Snell envelope of 

rt 



/ iJi(s,X s )ds+ max(-£ ik (t)+Y t k )l [t<T] 
Jo kej- 1 



0<t<T 
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Therefore, thanks to the Doob-Meyer decomposition of the Snell Envelope of processes (Proposition 
2-(m)), there exist continuous martingales (M t l )t<T and continuous, resp. purely discontinuous, non- 
decreasing processes (A\) t <r, resp. (B\)t<T, such that, for each % G J, and < t < T, 

f* Us, X s )ds + Yf = Ml -A\- B\ = Bj = 0). 

Moreover, the following properties for the jumps of B l , i G J hold. When there is a jump of B l at 
t, there is a jump, at the same time t, of the process (maxj. e j-i(- ^ifc(i) + it ))t<r- Since £jj are 
continuous, there is j G ^7"* such that Atl^ 1 = —A t B^ < and Y/_ = —£ij(t) + Y/_. Suppose now 
there is an index i± e J for which there exists t G [0, T] such that A t B l1 > 0. This implies that there 
exists another index %2 G J~ n such that A t B 12 > and Y/2 = —^^(t) + Y^l. But, given 12, there 
exists an index 13 G J r_i2 such that A t B %B > and Y^ = —£i 2 i z (t) + Y t !f ■ Repeating this argument 
many times, we get a sequence of indices i\, . . . , ij, . . . G J that have the property that ik G J~ %k ^ 1 , 
A t B ik > and F^" 1 = -ii k _ lik (t) + Y£. 

Since J7" is finite then there exist two indices m < r such that i m = i r and i m , i m +i, i r -\ are 
mutually different. It follows that: 

As i m = i r we get 

"^mim+l (t) — ■ ■ ■ — ii r _ 1 i r (t) = 

which is impossible since for any i 7^ j, all < t < T, £ij(t) > 7 > 0. Therefore, there is no i G for 
which there is a t G [0, T] such that A t B l > 0. This means that B % = and the processes Y 1 , . . . , Y q 
are continuous. Since they satisfy (21), then, by uniqueness, Y l = Y\ for any i G J. Thus, the 
Verification Theorem 1 is satisfied by Y 1 , . . . , Y q . □ 

We end this section by the following convergence result of the sequences (Y*' n ) n >o to Y l, s. 
Proposition 4 It holds true that, for any i G J, 

B[sup \Y^ n - Y l s \ p ] ^ as +00. 

s<T 

Proof. By Proposition 3, we know that P-a.s., for any n > 1, the function t 1— > Y t l ' n (o>) is continuous 
and for any < t < T the sequence (Y/' n (w)) n >i converges increasingly to Y t l (uj). As the function 
1 1 ^ Y t l (u;) is continuous then thanks to Dini's Theorem it holds true that: 

P-a.s. lim sup \Yj' n (w) - Yt(u)\ = 0. 

The result now follows from the Lebesgue Dominated Convergence Theorem. □ 
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5 Connection with systems of variational inequalities 

When the underlying market price process X is Markov diffusion and the switching costs are of the 
form £ij(t,X t ), the classical methods of solving impulse problems (cf. Brekke and 0ksendal (1994), 
Guo and Pham (2005)) formulate a Verification Theorem suggesting that the value function of our 
optimal switching problem is the unique viscosity solution the following system of quasi-variational 
inequalities (QVI) with inter-connected obstacles 

min{0j(t,x) - max jeJ -i(-£ij(t,x) + (f>j(t,x)), -d t (f>i(t,x) -A(f>i(t,x) -ipi(t,x)} = 0, 
<j) i (T,x) = 0, i€j, 

v 

where A is the infinitesimal generator of the driving process X. 

However, besides the technical difficulties to establish existence of a smooth solution, existence and 
uniqueness of a viscosity solution for such systems still remains open for most of the models discussed 
in the literature (See Carmona and Ludkovski (2006) for a detailed discussion). 

By means of yet another characterization of the Snell envelope in terms of systems of reflected 
Backward SDEs, due to El Karoui et al. (1997-l)(Theorems 7.1 and 8.5), we are able to show that 
the vector of value processes (Y 1 , . . . ,Y q ) of our optimal problem is a viscosity solution of the system 
(24), when the switching cost functions £ij are only deterministic functions of the time variable. An 
example of such a family of switching costs is 

£ij(t^) — e CL^j , 

where, ctjj are constant costs and r > is some discounting rate. 

We show that under mild assumptions on the coefficients ipi(t,x) and £ij(t), 

Y} = v%X t ), 0<t<T, is J, 

where the deterministic functions w 1 (t,x), . . . ,v q (t,x) are viscosity solutions of the following system 
of QVI with inter-connected obstacles 

min{vi(t, x) - max jeJ -i(-£ij(t) + Vj(t,x)), -dm(t,x) - Avi(t,x) - tpi(t,x)} = 0, 
< (25) 

Vi {T,x) = 0, iej. 
For (t,x) G [0, T] x M k , let (X t s x ) s <T be the solution of the following Ito diffusion: 

dXf = b(s, Xf)ds + a(s, X l s x )dB SJ t<s<T; Xf = x for s < t, (26) 

where, the functions b and a, with appropriate dimensions, satisfy the following standard conditions: 
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There exists a constant C > such that 

\b(t,x)\ + \a(t,x)\ < C(l + \x\) and |<r(t, z) - a(t, x')\ + \b{t, x) - b(t, x')\ < C\x - x'\ (27) 
for any t G [0, T] and x, x' G M k . 

These properties of a and b imply in particular that the process X tx := (X t s x )o< s <T, solution of (26), 
exists and is unique. Its infinitesimal generator A is given by 

-, d d 

A = - E (<T.<r*)i j (t,x)D ij +Y / b i (t,x)D i . (28) 
i,j=l i=l 

Moreover, the following estimates hold true (see e.g. Revuz and Yor (1991) for more details). 

Proposition 5 The process X tx satisfies the following estimates: 
(i) For any 6 > 2, there exists a constant C such that 

E[ sup \Xf f] < C(l + \x\ e ). (29) 

0<s<T 

(ii) There exists a constant C such that for any t,t' G [0, T] and x,x' G M k , 

E[ sup \Xf - Xi x '\ 2 } < C(l + \x\ 2 )(\x - x'\ 2 + \t- t'\). a (30) 

0<s<T 

Let us now introduce the following assumption on the payoff rates ipi and the switching cost 
functions tif 

Assumption [H]. 

(HI) The running costs ipi, i = 1, . . . , q, (of Subsection 2.1) are jointly continuous and are of polyno- 
mial growth, i.e., there exist some positive constants C and S such that for each % G J , 

\^i{t,x)\ <C(l + \x\ s ), (t,x) G [0,7] xM k . 

(HI) For any i,j G J, the switching costs £{j are deterministic functions of t and continuous and there 
exists a real constant 7 > such for any < t < T, mm{£ij(t), i,j G J, i / j} > 7. 

Taking into account Proposition 5, the processes (ipi(s, ^ x )o<s<T)j=i,g belong to M. 2,1 . A condition 
we will need to establish a characterization of the value processes of our optimal problem with a 
class of reflected backward SDEs. Note that the required polynomial growth condition on the ipi's is 
not contradictory with the condition listed in Assumptions 2.1 (ii), since the process X tx has finite 
moments of all orders (see also Remark 1). 

Recall the notion of viscosity solution of the system (25). 
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Definition 1 Let (v\, . . . ,v q ) be a vector of continuous functions on [0,T] x M k with values in M q 
and such that (v\, . . . , v q )(T, x) = for any x G M k . The vector (v i, . . . , v q ) is called: 

(i) A viscosity supersolution of the system (25) if for any (t ,x ) G [0,T] x M k and any q-tuplet 
functions (ipi, . . . ,<p q ) G (C 1 ' 2 ([0,T] x M k )) q such that (<^i, . . . , <p q )(t , x ) = (vi, . . . , v q )(t , x ) 
and for any i G J, (t ,xo) is a maximum of ipt — then we have: for any i G J ', 

mm{vi(t ,x ) - max (-£ij (t ) + Vj(t , x )), -d t <Pi(t , x ) - A<pi(t , x ) -ipi(t ,x )} > 0. (31) 
jej 1 

(ii) A viscosity subsolution of the system (25) if for any (to,xo) G [0, T] x M k and any q-tuplet 
functions (c^i, ... ,<p q ) G (C 1,2 ([0, T] x M k )) q such that (ipi, . . . ,<p q )(to,x ) = (v 1 , . . . ,v q )(t ,x ) 
and for any i G J , (to, xq) is a minimum of ipi — V{ then we have: for any i G J ' , 

miii{vi(to,xo) - m&x (-£ij(to) + Vj(t , x )), -d t <Pi(t , x ) -A(pi(t ,x ) - ipi(t , x )} < 0. (32) 

jej 1 

(Hi) The vector of function (v±, . . . , v q ) is a viscosity solution of the system (25) if it is both a viscosity 
supersolution and subsolution. 

Let now (Yj-> tx , . . . , Y q ' tx )o< s <T be the vector of value processes which satisfies the Verification 
Theorem 1 associated with (tpi(s, Xl x )) s < T and t j (t). The vector (Y 1 ^, . . . , Y q ' tx ) exists through 
Theorem 2 combined with the estimates of X tx of Proposition 5 and Assumptions [H] . 

The following theorem is the main result of this section. 

Theorem 3 Under Assumption [H], there exist q deterministic functions v l (t, x), . . . , v q (t, x) defined 
on [0, T] x M k and M-valued such that: 

(i) v 1 , . . . ,v q are continuous in (t,x), are of polynomial growth and satisfy, for each t G [0, T], and 
for every s G [t,T], 

Y l s ' tx = v l (s, X tx ), for every i G J. 

(ii) The vector of functions (v 1 , . . . , v q ) is a viscosity solution for the system of variational inequalities 
(25). 

Proof. The proof is obtained through the three following steps. 
Step 1. An approximation scheme 

For n > 0, let (Yg ,n ' tx )o< s <T, ■ ■ ■ , (Yg 1,n ' tx )o<s<T be the continuous processes defined recursively by 
Eqs. (17)-(18). Using Assumption [HI], the estimates (29) for X tx and Proposition 3, the processes 
Y i,n,tx _ ^ yq^tx belong to ^ Therefore, using a result by El Karoui et al. ((1997-1), Theorem 7.1) 
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which characterizes a Snell envelope as a solution for a one barrier reflected BSDE, for any n > 1 and 
i G J, there exists a pair of ^-adapted processes (Z i > n ' tx , K i,n ' tx ) with value in R d x R + such that: 

Y i ' n ' tx , K l ^ tx G <S 2 and Z*'"-*" € X 2 ' d ; iP>™' te is nondecreasing and K l Q ' n ' tx = 0, 

Yp n ' tx = [ T ^(u, X tx )du - f T Zil n ' tx dB u + Kif> tx - Ki' n > tx , for all < s < T, 

Js Js (33) 

Y i,n,tx > maXjeJ _ i {-£ ij (^ s ) + y^n-i.ta^ for all < s < T, 

f T (Y^ n ' tx - max {-tM +Yj> n - 1 > tx })dKii n = 0. 
I Jo jeJ- i 

Thanks to Theorem 8.5 in El Karoui et al. (1997-1) related to the representation of solutions 
of reflected backward SDEs, there exist deterministic functions v 1 ' , . . . ,v q, ° defined on [0, T] x R k , 
continuous and with polynomial growth such that for every (t, x) G [0, T] x R k and every % G J, 

Y*'°' tx = v i '°(s,X t s x ), t<s<T. 

Using an induction argument, and applying Theorem 8.5 in El Karoui et al. (1997-1) at each step, 
yields the existence of deterministic functions v 1,n , . . . , v q,n defined on [0, T] x R k , that are continuous 
and with polynomial growth such that, for every (t, x) G [0, T] x R k and every i £ J, 

yi,ntx = v i,n(^ x tx^ t <S<T. 

Since the sequences of processes {Y t,n,tx ) n >o is nondecreasing in n, then for any i G J~, the sequences 
of deterministic functions (t> l,n ) n >o is a l so nondecreasing. 
Moreover, we have 

v^(t,x) < < SUfmax^i,...,, Ms, X tx )\ds\F t ] 
< E[tf maXi=1 _ q Ms,X tx )\ds}, 

where, the last inequality is obtained after taking expectations, since v l ' n (t,x) is a deterministic 
function. It follows that for any i G J , the sequence (f*' n ) n >o converges pointwisely to a deterministic 
function v l and the last inequality in Eq. (34) implies that v l is of polynomial growth through ipi and 
the estimates (29) for X tx . Furthermore, for any (t,x) G [0, T] x R k we have 

Yp tx = v\s, X tx ), t<s<T. (35) 



Step 2. L 2 (P) -continuity of the value functions (t,x) — > y l ' tx . 

Let (t,x) and (t',x r ) be elements of [0, T] x M k . Using the representation (11) we will show that 

E[ sup \Y l / x ' - Y^ tx \ 2 ] -> as (t',x f ) -> (t,x) for any i G J. 
0<s<T 
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Indeed, recall that, by (11), we have, for any i <G J and s € [0, T] 



Y l s < tx = ess snp^ u)eVs E[ f ip Us (s, Xf)ds - ]T ^« T ._ 1 « T . fa)lfo<T] \F a . 

J S -\i 



where, P s is the set of finite strategies such that t\ > s, P — a.s. 
Therefore, 



Y i,t x _ < ess sup{Su)eV E[^ \^ Ur {r,Xl x ) - ip Ur (r,X? x ',u r )\dr\F s ] 

<E[[ (E - ^(r,^ V )|}^]. 



Now, using Doob's Maximal Inequality (see e.g. [26]) and taking expectation, there exists of a constant 
C > such that: 

E[ sup |yMx _y s i,f x'| 2] < CE[ [ T {^rm^X?) - Mr,Xt' x ')\} 2 ds]. (36) 

0<s<T JO - =1 

But, the right-hand side of this last inequality converges to as (t', x') tends to (t, x). Indeed, for any 
w > it holds true that: 

i-T 1 rT i 



E[[ {^m^Xln-M^Xl'^ds] <E[f {^|^(r,X^)-^(r,X^')|}21 [| ^ |+|x ^ |<ro]( i S ] 
i=l Jo i==l 

+£[ A^T |^(r,^) - ^(r,<-')|}21 [| ^ |+|x , V|>ro] d S ]. 
Jo i=i 

By the Lebesgue Dominated Convergence Theorem, the continuity of ipi and Estimates (30), the first 
term of the right-hand side of this inequality converges to as (t',x') tends to (t,x). 

The second term satisfies: 
E[[ T { E l^(r,^)-^(r,^')|}21 [| ^ |+|x , V|>ro] d S ] 

J0 i=l,...,q 

< {e[[ t { y: ^.(a; 1 )-*^!;' 1 ')!}^}^!/'!^,,^,^^}^ 

J0 i=l,...,q J0 

< {E[[ T { \Mr,X?) -^Xi x ')\}A]}h{ w ^E[ [ T (\Xl x \ + \X^'\)ds]}l 



4-i „/\ 



Using Estimates (29) and the polynomial growth of ipi, it follows that, when (t',x') tends to (t, x), 
the supremum limit of the right-hand side of the last inequality is smaller than tu~2 Ctx where Ctx is 
a constant. As w is whatever then going back to (36) and taking the limit to obtain, for any i G J ', 

E[ sup \Yt tx - Y^' x '\ 2 } -> as {t',x') -» (t,x). 

0<s<T 

Step 3. the functions v 1 , . . . ,v q are continuous in (t, x) and the vector of functions (v 1 , . . . , v q ) is a 
viscosity solution of the system of variational inequalities (25). 
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Thanks to the result obtained in Step 2, for any i G J, the function (s,t,x) i-> Yp tx is continuous 
from [0, T] 2 x iR fe into L 2 (P). Indeed, this follows from the fact that 

|ytfV _ y*,te| < |yjtV _ yjte| + _ y*,ta| < sup (|yMV _ y».**|) + | y j** _ 

s<T 

Therefore, the function (t,t,x) i— > y^' te is also continuous. But, the result obtained in Step 1, implies 
that Yt' tx is deterministic and is equal to v l (t,x). Hence, the function v l is continuous in (t,x). The 
deterministic functions v l , i G J , being continuous and of polynomial growth, by Theorem 8.5 in 
El-Karoui et al. (1997-1), these functions are viscosity solutions for the system (25). □ 2007 

6 Simulating the value-processes (Y 1 , Y q ) 

An important issues in the optimal multiple switching problem is to provide efficient algorithms to 
simulate of the value-processes (Y 1 , ...,Y q ) solution of the Verification Theorem 1. In this section we 
comment on this by providing yet another approximation scheme of the value-processes (Y 1 , Y q ) by 
exploiting their representation as solution for a system of BSDE with one reflecting barrier. Thanks to 
a result in El-Karoui et al. ((1997-1), Theorem 7.1) which characterizes a Snell envelope of a process 
which belongs to S 2 as a solution for a BSDE with one reflecting barrier, the vector (Y 1 , Y q ) is the 
solution of the following system of reflected BSDEs: 

For any i G J, there exists a pair of .^-adapted processes (Z l , K l ) with value in M d x M + such that: 

Y l , K l G S 2 and Z % G M 2 ' d ; K l is continuous nondecreasing and Kq = 0, 

Y* = f T ipi(u, X u )du - j T ZldB u + K l T - Kl, for all < s < T, 

J s Js ( 37 ) 

Y? > max JgJ -,{-£y(s) + Y/}, for all < s < T, 

[ T (Y: - max.{-^(«) + Yj})dKi = 0. 
I Jo j&J- 1 

Note that, when X = X tx , taking the limit in (33), we obtain the solution of the system (37). 

It is now well known that the solution of a reflected BSDE can be approximated, in using a 
penalization scheme, by solutions of standard BSDEs (see El-Karoui et al. (1997-1) for more details). 
Indeed, for n > 0, consider the following sequence of SDEs 

Y/' ra = [ T ^(s, X s )ds + n / Vi'" " Y^+ds - [ T Zl' n dB s , iej, t G [0, T] , (38) 
Jt Jt Jt 

where, for every i G J , 

Uf= max(-^(t)+Y t fc ' n ), t€[0,T\. 
Now, if we define the generator /„ = {ft, ...,/«) : [0, T] x M q — > M q by 

fn{s,{yi,-,y q )) = tpi(s,X s ) +n( max {-l ik (s) + y k ) - yi) + , i G J, 
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the Mi-valued process Y n = (Y 1 -™, . . . , Y<?> n ) satisfies the following BSDE: 

Y t n = jT f n (s, Y s n )ds - £ Z n s dB s , t G [0, T]. (39) 

The function f n being Lipschitz continuous w.r.t. y, uniformly in t, therefore through a result by Gobet 
et al. (2005) on numerical schemes of BSDEs, this multidimensional equation can be numerically 
solved, at least in the case when the process X is a Markovian diffusion. Therefore, this provides a 
way to simulate Y l since, as we will show it in Theorem 4 below, the sequence (Y* ,ri ) n >o converges to 
Y % . Indeed, we have: 

Proposition 6 For every i G J and every t G [0, T], the sequence (Y t l,n ) n >o is non- decreasing and 
P-a.s. Y/' n < Y t \ 



Proof. For n G JN, and k G IN*, consider the following scheme. For every i G J 
cT rT r T 

and 



y i,n,k = f T ^ Xs)ds + n f T { max ( _^. (s) + yj, n ,k-i) _ Y ^ k )+ds - [ Zi> n > k dB s , t G [0, T] 
Jt Jt jeJ- % Jt 



Y i,nfi = E ^ ^ Xs )ds\T t \, t<T. 

From a result in El Karoui et al. (1997-1), Y l,n ' k converges to Y l,n when k tends to infinity. Now, let 
us show by induction on k that: 

P - a.s. Y^ n ' k < y/< n+1 ' fc , n > o, i G J, t G [0, T] . 

For k = the property holds true. Suppose now that it is also verified for some k — 1 and let us show 
that it is valid for k. For any n > 0, i G J and t G [0, T] we have: 

Y i,n+l,k = F ^ SyXs )ds+(n+l) f T '( max (_£ ( s ) + y s J>+l,fc-l) _ yi,n+l,fc) + ds _ F Z i> n+1 > k dB s 

Jt Jt jeJ-* Jt 

and 

^,n,* = /" T ^ ^ )ds + n (_ e (s) + y^fc-l) _ y;,n,fc) + ds _ ^ Z ^ k dB s . 

Jt Jt jej-* Jt 

Thanks to the induction hypothesis, for any n > 0, i G J and t < T, we have y^™^" 1 < Y t i ' n+1 ' k ~ 1 . 
Therefore, using the comparison theorem of solutions of standard BSDEs (see e.g. El Karoui et al. 
(1997-2), Theorem 2.2) we get that 

which is the desired result. Now taking the limit as k goes to +oo, we obtain, for any n > and 
i G J, Y^ n < yvH- 1 . 
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To finish the proof it remains to show that for any k > and n > we have Y^' n,k < Y t l for any 
i e J and t < T and then take the limit as k goes to infinity. Once more using induction on k, it 
hods true that, for all k > 0, n > and t G [0, T], 

yi,n,k < yi^ for ^ • G j 

Indeed, for k = the property is obviously satisfied. In order to go from k to k + 1, we note 
that, by Eq. (37), and since for that k, Y^ n ' k < Y t \ for any i E J, it holds that for every t < T, 

(max^-^) + if*'*) - 1?)+ = 0. 
Hence, for all i < T, 

Y l t = / 4>i(s, X s )ds + n [ T ( max (-^(s) + F/' n ' fe ) - y?) + ds + K l T - K l t - T Z\dB s . 
Jt Jt jeJ- % Jt 

Now, taking into account that the process K l is non-decreasing and finally and using the Comparison 
Theorem of solutions of standard BSDEs, we get that 

yi,n,k+l < for any i G ^_ 

Finally taking the limit as /c — > oo we get that, for all n > and £ <G [0, T], 

y/' n < y/, for any i G J. 

The proof is now complete. □ 

Theorem 4 For any i G J it holds true that: 

E[ sup |y/' n - y/| 2 ] -^Oosn^oo. 
0<<<T 

Proof. We have, for every i G J and all t G [0,T], y/' n < Therefore there exists a process y* 

such that, 

lim y*> n = y/ < y/, t g [o,t]. 

Moreover, from (38) we get that, for any t <T, 

y/' n = ess snp T y t E[J\ i (s,X s )ds + (V; n A y;>")l [r<T] |.F t ]. 

This is due to the facts that the process n f (Ll> n — Yp n ) + ds is increasing and satisfies Jq{Y^ u — Uf 1 A 
Yg' n )n(L l s ' n — Yg' n ) + ds = 0. Therefore, in order to conclude, it is enough to use the representation 
result by El Karoui et al. (1997-1) of solution of reflected BSDEs as Snell envelopes of processes. 
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Now, since the process Y/ ,ri + /J ipi(s, X s )ds is a continuous supermartingale, the non-decreasing limit 
Y l is a cadlag process. Using now the result given in Proposition 2 - v, it follows that 

Y l t = ess sup T > t E[£ \pi(s,X s )ds + (I* A F r l )l [r<T] |^], t < T 

with Zj = max (—£ik(t) + is the nondecreasing limit of L*' n . But, from (38), taking expectation, 
dividing by n and taking the limit as n — > oo we obtain 

r-T 



/ (Z; - = o 

JO 



which implies that for any t < T, Y t l > L\, since these latter processes are cadlag . Now we can 
argue as in Section 4 to show that the processes Y l , i G J', are continuous. Therefore they satisfy 
the Verification Theorem whose solution is unique. Hence, for any i € J, we have Y % = Y % and the 
sequences (Y l ' n ) n >o are nondecreasing and converge to the continuous processes Y % . Finally in order 
to conclude we just need to use first Dini's Theorem and then the Lebesgue dominated convergence 
theorem. □ 

Remark 2 It doesn't seem easy to obtain a convergence rate of Y l,n to Y l . In the two-modes case 
and when the switching costs are constant, Hamadene and Jeanblanc (2007) (Proposition 4-2) show 
that the rate of convergence is ^ . This very interesting issue will be addressed in a forthcoming work. 
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